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Fewer than one in six low-income youth in the United States complete a bachelor’s degree, limiting their 
future potential earnings and social mobility (Kena et al. 2015). College Track’s mission is to address this 
challenge by supporting students from underserved communities, many of whom will be the first students in 
their families to attend college. 


College Track’s approach encompasses a long-ranging commitment from early high school through 
college graduation. During high school, students participate in intensive study groups, dedicated summer 
programming, experiential education, and preparation for standardized college entrance exams. College 
Track maintains active partnerships with colleges to ensure continued support—academic, social, and 
financial—for students as they progress through college and achieve a four-year degree. The organization 
currently operates in several California cities, Colorado, New Orleans, and Washington, DC. 


College Track and Mathematica have partnered to conduct a rigorous experimental evaluation of the College 
Track program. Results will not be available for several years, as students in the study progress through high 
school and college. In the meantime, Mathematica analyzed existing data to benchmark the postsecondary 
outcomes of College Track students relative to other students with similar backgrounds. Compared to similar 
students, were students served by College Track more likely to apply to, enroll in, or persist in college? 


Analytic approach 


This brief benchmarks the postsecondary 


outcomes of College Track students in the 9th The benchmarking analysis examines the post- 


grade cohort of 2009 relative to other students secondary outcomes of College Track students 

in the same cohort with similar backgrounds. who entered gth grade in 2009 and remained in 

The following key findings emerged: College Track through high school graduation in 

- College Track completers were more likely than 2013.* Comparison students were drawn from a pool 
similar students to apply to multiple colleges. of nationally representative students from the High 

- College Track completers enrolled in college at School Longitudinal Survey of 2009 (HSLS) developed 
higher rates than similar students, and by the National Center for Education Statistics 
were much more likely to enroll in four-year (Rogers et al. 2018). The HSLS followed a cohort of 
colleges specifically. students who entered 9th grade in 2009 until 

+ Persistence in college was similar among 2016—those students’ expected third year of college 


students who enrolled in college, although 
College Track uses a stricter and more rigorous 
definition of persistence. 


enrollment. Thus, the study can compare College 
Track and similar students in the HSLS who entered 
9th grade in the same school year. 
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We used an approach known as propensity-score 
matching to identify comparison students in the HSLS 
data with similar background characteristics as the 
students who completed College Track. Because 
students had to graduate from high school to complete 
College Track, we first restricted the pool of HSLS 
students to high school graduates only. We then 
matched each College Track student with students in 
the remaining HSLS sample who had similar demo- 
graphic characteristics and baseline academic achieve- 
ment. The final analysis sample consisted of 147 College 
Track students and 1,039 matched comparison students? 


After matching, comparison students had similar back- 
ground characteristics as the College Track students 
based on the available data (Figure 2). Next, we 
compared the postsecondary outcomes of the College 
Track and comparison students using linear regression, 
which accounted for any small remaining differences 
on their baseline characteristics. However, as in any 
non-experimental analysis, other baseline differences 
that the available data did not capture are still possible. 
Further details on the sample selection, methodology, 
and results are available in the Technical Appendix. 


Figure 1. Construction of the College Track 
analysis sample 


All College Track 
students in 2009 
(N = 278) 


Completed the 
College Track 
program 
(N = 159) 


Matched to 
comparison 
students 
(Ned) 


Figure 2. Student baseline characteristics after matching 


Percentage female 


Percentage non-Hispanic, 
black/African American 
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Percentage first-generation 
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Average GPA in 9th grade 


i College Track completers 


Note: None of the differences are statistically significant at the 5 percent level. 


GPA = grade point average. 
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Data sources 


The benchmarking analysis uses administrative data collected by College Track, together with public-use data from 
the HSLS. Having different data sources for the College Track and comparison groups can present challenges in 
defining baseline and outcome measures comparably. Table 1 presents the definitions of each baseline and outcome 
measure used in the analysis. 


Table 1. Baseline and outcome measures 


(ore) | {Yo l- Wa We-Lol we (Vi laliateyal HSLS definition 


Baseline measure 


Gender Female or male Female or male 
Low-income status Eligible for free or reduced-price lunch (FRPL) Above or below 185% federal poverty level (FPL)t 
First-generation college Neither parent has bachelor's degree or higher from Neither parent has a bachelor's degree or higher 
student a US. institution 
GPA in 9th grade Semester 1 GPA, unweighted Cumulative year GPA, unweighted 
Race or ethnicity (1) Non-Hispanic, black/African American (1) Non-Hispanic, black/African American 
(2) Hispanic (2) Hispanic 
(3) Other (3) Other 
Ever applied to college Number of applications > O Number of applications > 0 
Applied to 3 or more colleges Number of applications = 3 Number of applications > 3 
Ever enrolled Ever attended a 2-year or 4-year college Ever attended a 2-year or 4-year college 
First enrollment: College type (1) 2-year college (1) 2-year college 
(2) 4-year college (2) 4-year college 


First enrollment: 
College selectivity+ 


1) 2-year college 

2) 4-year college, inclusive 

3) 4-year college, moderately selective 
4) 4-year college, highly selective 


1) 2-year college 
2) 4-year college, inclusive 
3) 4-year college, moderately selective 


( 
( 
( 
4) 4-year college, highly selective ( 


( 
( 
( 
( 
First enrollment: Student continuously enrolled in college of same or Student enrolled in college of same or higher type 


Student persisted to 2nd year higher type (2-year versus 4-year) from fall of (2-year versus 4-year) in at least 2 calendar years 
academic year through successive fall term 


+ 130% of the FPL is the threshold for free lunch eligibility. Students between 130% and 185% of the FPL are eligible for reduced-price lunch 
(Food and Nutrition Service 2009). 


+ Selectivity of colleges is determined by the Carnegie Classification of Institutions of Higher Education. 


GPA = grade point average. 
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Findings 


College Track completers were more likely than 
similar students to apply to multiple colleges. 
Students who completed College Track in 2013 
applied to college at higher rates than comparable 
students in the HSLS. The difference in the percentage 
of students who submitted multiple applications 

is especially large—97 percent of College Track 
students submitted three or more applications, 
compared to 45 percent of comparison students. 


College Track completers enrolled in college at 
higher rates than similar students, and were much 
more likely to enroll in four-year colleges specifically. 
All the students who completed College Track 
attended college, making them 27 percentage points 
more likely than comparison students to enroll 

in either a two- or four-year college. In addition, a 
much larger share of College Track students 


Figure 3. Comparison of college entry outcomes 


(78 versus 41 percent) enrolled in four-year colleges 
relative to comparable students in the HSLS, who 
were more likely to enroll in two-year colleges 
instead. Promoting enrollment in four-year colleges 
is an explicit mission of College Track. 


Compared to similar students in the HSLS who also 
enrolled in college, College Track students were less 
likely to first enroll in a two-year college and more 
likely to first enroll in an inclusive four-year college 
(the lowest selectivity level of four-year colleges). 

In addition, College Track students were less likely 
than comparison students to first matriculate in 

a moderately selective four-year college and more 
likely to first matriculate in a highly selective four- 
year college (the highest selectivity level). These 
findings suggest that College Track may help 
students attend colleges in a higher selectivity level 


than they otherwise would. 


Ever applied to college 99" 
Submitted 3 or more O75 
college applications 
Ever enrolled in 100* 
2-year or 4-year college 
First enrolled in 2-year college 
First enrolled in 4-year college 
O 20 40 60 80 100 
Percentage 
Hi College Track completers [-] Comparison 


Note: The sample for the college entry outcomes is limited to high school graduates. 


* Difference is statistically significant at the 5 percent level. 
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Figure 4. Comparison of college selectivity outcomes 


First enrolled in 2-year college 


First enrolled in 
4-year inclusive college 


First enrolled in 4-year, 
moderately selective college 


First enrolled in 4-year, 
highly selective college 


O 20 40 60 80 100 
Percentage 


i College Track completers Comparison 


Note: The sample for all college selectivity outcomes is limited to students who enrolled in college. 


* Difference is statistically significant at the 5 percent level. 


Persistence in college was similar among 


students who enrolled in college, although Figure 5. Comparison of college 
College Track uses a stricter and more rigorous persistence 
definition of persistence. College Track students 100 


persisted at a similar rate to comparable students in 


the HSLS who also enrolled in college (81 versus D 81 a 
87 percent). The small difference between the two . 3 80 

groups is not statistically significant. This result c i 

is at least partially explained by the different oa, 60 

definitions of persistence, as College Track ub a 

requires that students be continuously enrolled 5 A 

for at least three semesters. In contrast, students i) 2 40 

in the HSLS only had to be enrolled in at least two © 2 

calendar years, which could include time off (see = a 

Table 1). In addition, a higher share of College Track oe 

students enrolled in four-year rather than two-year 2 

colleges. When we examined college persistence 3 0 

among students in four-year colleges only asa Biicollece tack completers ompancen 


secondary analysis, we found no difference between 


College Track and comparison students (see Table A.3 Note: The differences is not statistically significant at the 5 


in the Technical Appendix). percent level. The sample for the college persistence outcome is 
limited to students who enrolled in college. 
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Limitations 


This analysis offers a useful benchmark for assessing 
the outcomes of students who completed College 
Track, but has several limitations and thus is not 
intended to evaluate the impacts of the program. 


Some limitations stem from using a different 
source of data to identify the comparison group. 
First, the two data sources define certain measures 
somewhat differently. The only measure of baseline 
achievement available—9th grade GPA—was mea- 
sured over a different time span (first semester for 
College Track versus end of 9th grade in the HSLS).3 
Most notably, College Track defined the persistence 
outcome more strictly than is possible in the HSLS 
public-use data, requiring continuous enrollment 
for three semesters rather than enrollment in two 
calendar years. Second, geographic locations are 
not available in the public-use HSLS data and thus 
could not be used in matching, which means 
comparison students could have experienced different 
environments from College Track students, who 
attended high school in the San Francisco Bay Area 
and New Orleans. 


In addition, the benchmarking analysis was based 
ona subset of all College Track students—those 
who completed the program and thus participated 
in outcome data collection. These students, who 
represent 57 percent of the 9th-grade cohort who 
entered College Track in 2009, had higher academic 
achievement at the start of the program, as measured 
by 9th-grade GPA. Therefore, the students in the 
analysis might have better postsecondary outcomes 
than other College Track students. Moreover, we 
were unable to examine whether College Track 
might help students graduate from high school 
because that information was available only for the 
subset of College Track students who graduated 
from high school. 
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It is also important to note that this analysis focused 
on a single cohort of students who attended high 
school from 2009 to 2013. Since then, College Track 
has made changes to staffing, geographic reach, 
and programmatic characteristics as subsequent 
cohorts have progressed through the program. 


Looking ahead 


College Track students in the 9th-grade cohort of 
2009 performed favorably on many postsecondary 
outcomes relative to a comparison group of similar 
students drawn from the HSLS. For example, 
College Track completers were 37 percentage points 
more likely to enroll in a four-year college. Although 
these initial findings are encouraging, the rigorous 
experimental evaluation Mathematica and College 
Track are conducting will contribute more robust 
evidence of the program's impacts in the years to 
come. Final results from the experimental evaluation 
are expected to be available in 2024. 
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Technical appendix 


Sample selection 


The College Track analysis sample was restricted to 
147 of 268 students in the 9th-grade cohort of 2009 
who completed the program because outcome data 
were available only for this portion of the cohort. 
We constructed the HSLS analysis sample to 
maximize its comparability with the College Track 
sample. We first excluded any students who did not 
respond to all of the relevant survey instruments. 
We also restricted the HSLS sample to students in 
similar schooling environments as College Track 
students—those enrolled in public high schools in 

a city or suburb. Next, we removed HSLS students 
who were missing postsecondary outcome data. We 
then limited the sample to high school graduates for 
all outcomes, resulting in 5,161 potential comparison 


to college enrollees, creating a potential comparison 
group of 4,061 students. For a secondary analysis of 
college persistence, we further limited the sample 
to four-year college enrollees, creating a potential 
comparison group of 2,625 students. 


Methodology 


We estimated a propensity score for each eligible 
College Track and HSLS student using a logistic 
regression model. The propensity score indicates 
the likelihood of completing the College Track 
program, given a student's baseline characteristics. 
After generating propensity scores, we matched 
each College Track student with up to 20 compari- 
son students who had the most similar propensity 
scores within a given threshold or radius of their 
propensity score. If there were no eligible compari- 
son students within the matching radius for a given 


group students. To analyze college selectivity and College Track student, we excluded that student 


persistence, we additionally restricted this sample from the benchmarking analysis. 


Table A.1. Construction of the analysis sample 


Sample size 


College selectivity 


(ove) |(-Te[-W-Taiavg 
outcomes 


and persistence 
outcomes 


hY-Levelalol- Tay 
persistence outcome 


College Track 


All records 278 278 278 
Completed the College Track program 159 159 159 
4-year college enrollees ule) 
Matched to comparison students 147 148 110 
All records with responses to relevant survey instrumentst 13,442 13,442 13,442 
Enrolled in public high school located in a city or suburb 6,617 6,617 6,617 
Had complete outcome data 5,762 5,762 5,762 
High school graduates 5,161 5,161 5,161 
College enrollees 4,061 4,061 
4-year college enrollees 2,625 
Matched to College Track students 1,039 847 497 


+ Instruments used in the analysis include Base-year, 2013 Update, High School Transcript, and Second Follow-Up. 
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After removing College Track students without 
appropriate matches, the final analysis sample for 
college entry outcomes included 147 of 159 College 
Track completers. These students were matched 
with 1,039 comparison students from the HSLS 
data. For the analyses of selectivity and persistence, 
which were restricted to students who enrolled in 
college, we successfully matched 148 College Track 
students with 847 comparison students from the 
HSLS data. The analysis sample restricted to four- 
year college enrollees used for the secondary college 
persistence outcome is composed of 110 College 
Track students and 497 comparison students. 
Table A.2 compares the baseline characteristics of 
the matched groups for each analysis sample. The 
remaining differences between the College Track 
and comparison students in the analysis samples 
are small and not statistically significant. 


To measure differences in the outcomes of College 
Track and comparison students, we estimated an 
ordinary least squares regression model: 


QQ pO PAP 01. 4s. 


where y, is the outcome of interest for student i; 

X, is a vector of baseline characteristics for student i; 
Tis a binary variable indicating whether student jis a 
College Track completer; ¢,is a random error term 
that reflects the influence of unobserved factors on 
the outcome; and 6 and f are parameters or vectors 
of parameters to be estimated, with 6 representing 
the difference of interest. Because each comparison 
student could be matched to multiple College Track 
students, we used a weighting scheme in which 
each student participating in College Track received 
a weight of one, and each comparison student received 
a weight representing the fraction of the number of 
College Track students to whom they were matched. 
Thus, among matched students the sum of the 
weights for the College Track students is equivalent to 
the sum of the weights for the comparison students. 


Results 


Table A.3 shows the detailed results for each out- 
come, in which the College Track percentage 
represents the actual share of students achieving 
that outcome and the comparison percentage is 
regression-adjusted using the estimated difference 
obtained from Equation (A1), also displayed in the table. 


Table A.2. Baseline characteristics after matching 


alte] aMexeialete) Me e-Ye LUr-yn=s-4 (ove) | (-Te (“Tal ce) | (1-14 rer lacexe) (-te [Mla ce) |(-x-3-4 


College Track HSLS College Track HSLS College Track HSLS 
Female (%) 64.63 65.11 64.19 62.69 64.55 63.74 
Non-Hispanic, black/African American (%) 46.94 48.20 47.30 4T44 Sry 59.29 
Hispanic (%) 35.37 S759) 35.14 34.79 25.45 22.81 
Low income (%) 59.86 58.84 58.11 59.43 60.91 63.62 
First-generation college student (%) 78.91 VAI) 79105 7730 78.18 77.88 
Average GPA in 9th grade 273 277 272. 2.67 2.81 2.76 
(0.70) (0.87) (0.70) (0.78) (0.64) (0.66) 


Note: None of the differences are statistically significant at the 5 percent level. Standard deviations are in parentheses for continuous baseline 
characteristics. 


GPA = grade point average. 
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Table A.3. Comparison of outcome measures 


Mean Sample size 


Cove) |(-Te[-1 i} t-Talet-1 ce] (ove) |(-To[-1 
Track Difference error Track HSLS 


alte }aW-xer aCete) Mele-Ce[UE-1x-s-M-t-T nal ol (-} 


Ever applied to college 98.64 91.94 6.70" 1.65 0.000 147 1,039 
Submitted 3 or more college 96.60 45.19 SAH 275 0.000 147 1,039 
applications 

Ever enrolled in 2-year or 4-year college 100.00 73.41 2650" 2.16 0.000 147 1,039 
First enrolled in 2-year college 21.80 35.39 -11.59* 3.86 0.003 133 1,039 
First enrolled in 4-year college 78.20 40.74 37.45* 4.07 0.000 133 1,039 
First enrolled in 2-year college 22.56 48.28 -25.72* 4.20 0.000 133 847 
First enrolled in 4-year, inclusive college 36.84 10.10 26,75* 4.15 0.000 133 847 
First enrolled in 4-year, 18.80 30.57 -11.77* 4.16 0.005 133 847 
moderately selective college 

First enrolled in 4-year, 21.80 oma LoS" 3.82 0.004 133 847 
highly selective college 

Enrolled in college and 81.08 87.36 -6.28 3.45 0.069 148 847 


persisted to 2nd year 


re -t-lacexe) |(-te[-M-Valco)|(-x-s-M-t-Teal ol (-3 


Enrolled in 4-year college and 88.18 88.45 -0.27 3.76 0.943 110 497 
persisted to 2nd year 


* Difference is statistically significant at the 5 percent level. 


3 Prior academic achievement is a strong predictor 
Endnotes rors 
of postsecondary outcomes and is thus an important 
1 College Track collects postsecondary outcome data only baseline measure for this analysis. However, in addition 
for students who complete the College Track program 


through high school graduation. As a result, the bench- 


to being measured over a different time span in the two 
data sources, our 9th-grade GPA measure has two other 


marking analysis focuses on high school graduates. In the 
gth-grade cohort of 2009, 159 of 278 students (57 percent) 
completed College Track. 


? Of the 159 College Track students who completed the 
program, 12 could not be matched because no HSLS 
students resembled them sufficiently. Analyses of college 
selectivity and persistence were further restricted before 
matching to students who enrolled in college, resulting in 
an analysis sample size of 148 College Track students and 
847 comparison students. See the Technical Appendix for 
additional details. 


limitations. First, it is not a true baseline, in that students 
started participating in College Track the summer before 
starting 9th grade. Second, it is not very proximate to the 
outcomes we analyzed, which other academic experiences 
students had after 9th grade could influence. 


* The threshold value is 0.027 for the high school graduate 
sample, 0.017 for the college enrollee sample, and 0.042 
for the four-year college enrollee sample. These thresholds 
were selected to maximize the baseline equivalence of the 
matched samples. 
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